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Method and device for oneratincf a night: vision gygtem 

for cars 



The invennion relates to a method for operation of an 
5 automobile night vision system, and to an apparatus for 
use of the method for operation of an automobile night 
vision system. 

poor visibility at night is a stress -creating and 

10 dangerous situation in road traffic, which is feared by 
many drivers • As a consequence of poor visibility, the 
accident probability at night is considerably higher 
than when driving in the daytime and in good 
visibility- in the future, automobiles will be equipped 

15 with night vision systems in order no improve road 
traffic safety. The night vision systems which will be 
used for this purpose normally operate in the near 
infrared wavelength band (NIR) . Since the radiation 
from the NIR headlights which are used in conjunction 

20 with automobile night vision systems is invisible to 
the human eye, this represents a danger against which 
people must be protected. However, protection against 
the NIR radiation is only one reason why night vision 
systems can be operated only in very specific 

25 conditions. 

A system for assisting the driver's visual capabilities 
when driving at night is proposed on the Toyota Motor 
Corporation Internet page 

30 ( www . toyota > co . -jp/ Showroom/ All toyota 

lineup/LandCruiserCvcmus/safety/index.html ) . When 
dipped headlights are switched on, the system shows the 
road profile, which is difficult to see in front of the 
light beam of the vehicle, and the objects located in 

35 the surrounding area. The system also provides 
assistance to long-distance vision, in particular in 
situations in which it is impossible to drive on main 
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beam. In this case, che night vision system uses 
invisible near infrared rays, which are not perceived 
by the human eye. The energy, which is invisible to the 
human eye, is recorded by an IR camera fitted in the 
5 vehicle, and is processed no form an image. The 
processed image is then projected by means of a head-up 
display onto che vehicle windshield. 

For safety reasons, the "Night -View" system must not be 
10 used as the sole source of vision. The system safety 
can in this case be adversely affected by a large 
number of factors, such as rain, a dirty windshield, 
poorly reflective clothing, etc. 

15 Furthermore, there is the possibility of danger to 
people in the vicinity of the vehicle as a result of 
the invisible radiation from the IR illumination, for 
which reason the infrared transmitter should not be 
looked at for a lengthy period from short range- 

20 

The following operating conditions must therefore be 
satisfied at the same time for operation of the night 
vision system: ignition ON, surrounding area dark, 
headlights ON, night-view switch ON, and furthermore 
25 the speed of travel must be at least 30 km/h. The 
disadvantage in this case is that the system cannot be 
designed to be flexible, and cannot be operated such 
that it is adapted to different situations. 

30 The invention is thus based on the object of providing 
a novel method for operation of an automobile night 
vision system, as well as an apparatus for use of the 
method as claimed in the precharacterizing clauses of 
patent claims 1 and 10, which allows the night vision 

35 system to be designed' to be flexible, and allows the 
system to be operated such that it is matched to 
different situations. 
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According no che invencion, the object is achieved by a 
method and an apparatus having the features of patent 
claims 1 and 10. Advantageous refinements and 
5 developments of the invention are specified in the 
dependent claims. 

According to the invention, a night vision system is 
operated on a vehicle- The night vision system in this 

10 case has an illumination unit for transmission of 
infrared radiation, by which means che surrounding area 
in fxonc of the vehicle is preferably illuminated. The 
infrared radiation which is reflected on the road 
surface and on other objects is detected by means of an 

IS image recording unit which is sensitive to the infrared 
wavelength band. An image processing unit is provided 
for evaluation of the detected data from che 
surrounding area. In this case, the purpose of the 
image processing unit is not only to convert the data 

20 from the surrounding area to an image, but also to 
allow object identification to be carried out. 

The components of the night vision system can be driven 
individually in a particularly advantageous manner by 

25 means of at lease one control signal. In this case, the 
control signal may, for example, be a control signal 
which is generated by an image processing linic, by an 
image recording unit, by further vehicle- internal 
systems or by user inputs (for example by means of a 

30 pushbutton or foot-operated switch) - It is thus 
possible to operate che individual components of the 
night vision system in different constellations. The 
invention therefore also for the first time maJces it 
possible to operate che night vision system such that 

35 it is flexibly matched to different situations. In chis 
case, all of the operating conditions need not 
necessarily be satisfied at the same time for operation 
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of Che individual cotrponents of the night vision system 
in different constellations. 

In one embodiment of the invention that results in an 
5 improvement, an optical display is provided as an 
additional component for the night vision system • The 
optical display is used primarily to display 
information from the surrounding area detected by means 
of the IR camera. The optical display furthermore makes 

10. it possible to display other information produced by 
the image processing unit, as well. For example, this 
may be image daca which represents object data or 
distance data. The optical display can be designed to 
be a head-up display in this case. An embodiment is 

15 also feasible in which a display is integrated in the 
vehicle cockpit, for the optical display. 

* 

In a further embodiment of the invention which results 
in an improvement, the night vision system is 

20 additionally equipped with an interface. The night 
vision system can interchange information with vehicle- 
internal systems via the interface. In this case, on 
the one hand, vehicle-internal systems can activate the 
components of the night vision system while, on the 

2S other hand, individual components of the night vision 
system can also transmit control signals to vehicle- 
internal systems - 



30 



35 



By way of exaniple, a navigation appliance which is 
fitted in the vehicle can activate the night vision 
system automatically at the appropriate time when the 
vehicle is approaching a tunnel, and shortly before 
driving into the tuimel, on the basis of information 
from digital maps. 

The image data which is detected by means of the camera 
of the night vision system (with the camera 
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advantageously being located in the area which is 
cleaned by the windshield and/or headlight cleaning 
system) can be evaluated in order to detect dirt on the 
windshield or headlights, and then to transmit a 
control signal to the control unit for the windshield 
and headlight cleaning system, and to activate the 
headlight cleaning system. The configuration of the 
night vision system need not include an optical display 
for this purpose. 

A further option is for the image processing unit to 
transmit a control signal to the control unit for the 
airbag devices on the basis of a danger situation 
having been identified, and in this way to preactivate 
these devices. 

In principle, it is feasible to transmit control 
signals from the night vision system to warning 
devices, in which case, for example, the warning signal 
20 may also be represented by means of a spoJcen output. 

It is particularly advantageous for the optical display 
to be automatically deactivated if the image data 
produced by the image processing unit is not 

25 automatically updated within a fixed predetexmined time 
interval. Otherwise, the driver would be uxmecessarily 
irritated by the displayed image not following the area 
surrounding the vehicle but being displayed as a 
stationary image. Alternatively, it would also be 

30 feasible, instead of deactivating the optical display, 
to deliberately display a fault message on the optical 
display. In order to allow such fianctionality, the 
control signal is in this case represented by the image 
data produced by the image processing. The control 

35 signal thus changes with the change in the displayed 
image data. If this control signal does not change 
within a predetermined time interval, this initiates 
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the deacrivation of the optical display. 

In one advauicageous embodiment of the invention, the 
night vision system is designed such that, in the 
5 situation where the control signal for operation of the 
night vision system is not requested automatically by 
vehicle-internal systems, but is requested manually by 
the driver, a change takes place in any case to the 
night vision display on the display unit. However, this 

10 is also the case when other conditions which are 
required for operation of the night vision system are 
not saciafied. For exaoiple, in this case as well, a 
change takes place to the night vision display when the 
vehicle is not moving and, in consequence, the infrared 

15 illumination cannot be activated for safety reasons. It 
is thus obvious to the driver that all of the necessary 
conditions for correct operation of all of the 
components of the night vision system are not 
satisfied, and that this is not a malfunction of the 

20 night vision system. 

In a further advantageous refinement of the invention, 
it is feasible for all of the individual components, in 
particular the illumination unit and the image 

2S recording unit, of the night vision system to be used 
in. order to communicate in the infrared wavelength band 
with other vehicles or traffic facilities. In this 
case, it is particularly advantageous for the night 
vision system to be configured such that it does not 

30 have an optical display. In this case, the optical 
display is not switched on, and the driver is thus not 
disturbed. 

In addition, in the situation where vehicle- internal 
35 systems generate a control signal for operation of 
individual components of the night vision system, all 
of the components of the night vision system are 
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included in the configuration, with the exception of 
the optical display. For example, a system which is 
based on radar signal processing for spacing control, 
or an image processing system for object 
5 identification, can request the functionality of the 
night vision system, with no optical display being 
required in this case, and thus without the driver 
being distracted. 

10 In situations in which a configuration which includes 
the optical display has already been active and 
communication is intended to be set up with other 
vehicles or traffic facilities or with vehicle-internal 
systems, the optical display remains in that 

15 configuration, and is not removed. 

A request for the night vision functionality may be 
requested both manually by the driver and by vehicle- 
internal systems- It is advantageous for the night 

20 vision system to be configured in such a way that it is 
activated in any case in the evenc of a request such as 
this for the night vision functionality. The components 
of the night vision system are also activated in 
circumstances in which no night vision functioioality 

25 would be required; for example during the daytime or 
when Che vehicle is stationary. The IR illumination 
unit is, however, switched on only as a function of 
other operating conditions, in order not to endanger 
other road users. The operating conditions for infrared 

30 illumination include dipped headlights having to be 
switched on, since the night vision system is otherwise 
not required. Furthermore, the vehicle must be moving 
at a predetermined minimum speed in order that no one 
can look directly into the IK illumination unit for a 

35 long time. However, for diagnosis purposes, the XR 
illumination unit can also be switched on separately by 
means of a special facility, when stationary . 
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In a further embodiment of the invention which results 
in an iraprovemenc , the night vision system may be 
configured such that all of the components can be 
5 activated individually, independently of the operating 
conditions. This is advantageous, for example, when a 
control signal for activation of the cons>onents of the 
night vision system is generated by means of vehicle- 
external diagnosis systems in workshops. The 
10 information interchange with vehicle-external diagnosis 
systems in this case takes place via vehicle -internal 
systems . 

By way of example, the figure shows the schematic 

15 layout of an automobile night vision system. In this 
ease, the night vision system coniprises an illumination 
unit (1) for illumination of the area surrounding the 
vehicle with infrared light • An image recording unit 
(2) which has a receiver which receives in the infrared 

20 wavelength band is used for scanning the area 
surrounding the vehicle, and for then converting this 
information to image data- The night vision system 
furthermore has an image processing unit (3), by means 
of which the image data can be evaluated and can be 

25 preprocessed for optical display. For optical display 
purposes, the night vision system is equipped with a 
display unit (4) which projects the image data onto the 
front windshield, for example, or presents it on a 
display in the cockpit of the vehicle. For information 

30 interchange with other coniponents, an interface (5) to 
. vehicle- internal systems is also provided. 
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